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Abstract 

The paper presents results from a psychophysical study conducted to optimize vibrotactile stimuli deliv- 
ered to subject finger tips in order to evoke the somatosensory responses to be utilized next in a haptic 
brain computer interface (hBCI) paradigm. We also present the preliminary EEG evoked responses for 
the chosen stimulating frequency. The obtained results confirm our hypothesis that the hBCI paradigm 
concept is valid and it will allow for rapid stimuli presentation in order to improve information-transfer- 
rate (ITR) of the BCI. 

1 Introduction 

The state of the art brain computer/machine (BCI/BMI) interfaces relay on visual and imagery paradigms [l] 
which require longer training or good vision from the subjects. Alternative solutions propose to utilize 
auditory |2| or haptic (somatosensory) modalities [3j[4] in order to enhance brain-computer interfacing 
comfort or to boost information transfer rate (ITR). 

A concept of utilizing brain somatosensory (haptic) modality creates a very interesting possibility to 
target tactile sensory domain, which is not as demanding as vision during operation of machinery or visual 
computer applications. A potential haptic/somatosensory BCI/BMI paradigm is thus potentially a less 
mentally demanding. The first successful trial to utilize steady-state somatosensory responses (SSSR) to 
create the BCI/BMI |3 targeted a very low stimulus frequency range of 20 — 31Hz to elucidate subject's 
attentional modulation. The lower frequencies excite Meissner-endings of human finger tips 5|. We 
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propose to utilize also higher frequencies in a range of 300 — 400Hz to stimulate Pacini-endigs js] , since 
these frequencies are very suitable for shorter stimulus delivery which would fit perfectly a somatosensory 
evoked potential (SEP) generation mechanism in the brain. 

In order to identify user's preferences before a final BCI/BMI paradigm design which will utilize 
stimuli-driven responses captured in EEG, we conduct first psychophysical experiments to identify the 
preferred stimuli frequencies from behavioral responses. This paper reports psychophysical results ob- 
tained from stimulation of the five fingers and a palm area of a single hand with various frequencies as 
depicted in Figure [ij Next we also present the preliminary results with SEP EEG averaged responses to 
validate our hypothesis of the hBCI concept. 

In the following sections we introduce vibrotactile stimulus delivery technique. Next we describe the 
psychophysical and EEG experiments. A statistical analysis of the obtained results discussion concludes 
the paper. 

2 Methods 

The SEP generated by the vibrotactile stimuli itself recorded in brain waves (EEG) is an evoked transient 
neural potential caused by the complex tactile stimulus. It is evoked by turning ON/OFF of a tactile 
vibration impulse [2j[4]. 

In order to design comfortable and easy to detect by human subjects the vibrotactile stimuli, which 
next will be utilized in BCI/BMI experiments, we conduct first preliminary experiments in order to 
determine stimulus difficulty from behavioral responses - "button presses" after identified targets. It 
is known, that a variability of psychophysical response time delays is related to task difficulty and the 
cognitive load. We aim to determine six vibrotactile stimuli frequencies with uniform task difficulties 
which could be next plugged into a haptic BCI/BMI paradigm. Next we also test brain SEP response in 
EEG. 

2.1 Vibrotactile stimuli delivery 

The vibrotactile stimuli were delivered as sinusoidal waves generated by a portable computer with 
Max/MSP software. The stimuli were generated via six (for psychophysical experiment) and two (for 
EEG measurement) channel outputs of an external digital-to-analog signal converter MOTU UltraLite- 
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mk3 Hybrid coupled with the YAMAHA P4050 power amplifiers. The stimuli were delivered to subject 
fingers via two types of tactile exciters working in the ranges of 300 — 20, 000 Hz (four small HIAX19C01-8) 
and 20 — 80 Hz (two large TT25-16 PUCK) as depicted in Figure [l] The subjects placed their palms 
and fingers on the exciters and attended (button-press responded in case of psychophysical or mentally 
counted only in case of EEG experiments) only to the instructed locations, while ignoring the other 
stimuli. 

2.2 The Psychophysical Experiment Protocol 

The psychophysical experiments were conducted in order to investigate stimulus carrier frequency relation 
on subject response time and accuracy. The behavioral responses were collected via a small numeric 
keypad as depicted in Figure [T] The subject used their dominant hand for responses, while the other 
hand was stimulated vibrot actually with various frequencies. Each trial was composed of a random order 
500 ms stimulation delivered to each finger with inter-stimuli-interval (LSI) of 500 ms. The subject was 
instructed in each trial to attend to one stimuli, while ignoring the others. The response times were 
registered with the same Max/ MSP patch which was used for the stimulus generation. 

2.3 The EEG Experiment Protocol 

The EEG experiments were conducted in order to confirm the SEP responses usability for the BCI/BMI 
paradigm. The experimental settings were as follows. 

The EEG signals were captured with eight dry electrodes portable wireless system by g.tec (g. SAHARA 
&i g.MOBIIab+). The electrodes were attached to following scalp locations Cz, CPz, POz, Pz, PI, P2, 
C3, and C4- The recorded EEG signals were processed by BCI2000 application |6 . The sampling rate 
was set to 256Hz, high pass filter at O.lHz, the low pass filter at 40Hz, and notch filter at 50Hz. 

The two stimuli types with the lengths of [50, 200] ms, or [50, 150] ms, were delivered randomly to 
the forefingers of subjects' both hands. Both of the stimuli types had the same carrier frequency of 
333 Hz. We chose this frequency since the psychophysical tests (see the summary Figure [5]) suggested 
that it caused the larger response time variability. During the experiment, each trial was composed of 
the single target and three non-targets stimuli presentation in a random train repeated ten times. The 
subject was instructed to attended to target stimulus while ignoring the other three types. This procedure 
was repeated for each stimulus as the target. The offline BCI paradigm experiments were conducted in 



4 



accordance with institutional ethical committee guidelines for experiments with human subjects. 



3 Results and Conclusions 



The behavioral results obtained for all subjects separately are presented in Figures 2]|4 in form of boxplots 



of the response time distributions. The results analysis have shown that the vibrotactilc stimuli frequency 
does not influence significantly the response delays. We conducted pairwise t-test and Wilcoxon analyses 
to confirm the observations. In both cases the means have been confirmed to be similar. The results 
rejected a hypothesis of mean differences for various vibrotactilc stimulating frequencies. A grand mean 
average for all subjects has been also presented in a summary Figure [5] 

We conclude the psychophysical experiments with an observation that vibrotaclite carrier frequencies 
in the ranges of 30—50 Hz and 300 — 400 Hz did not influence the instructed vibrotactilc target perception 
and cognition since the behavioral responses were the same, or differed non-significantly. Only the 333 Hz 
carrier frequency has caused larger response variability and it was chosen for the subsequent tests in EEG 
experiments. 

The EEG experiment results has been presented in Figures |6||8] where evoked responses to targets (top 
panels); non-targets (middle panels); and distance measures in form of correlation coefficients (bottom 
panels) indicating the features separability. For the three subjects we have observed clear differences in 
evoked potentials patterns between targets and non-targets, what is also obvious in correlation coefficient 
diagrams. Each subject on the other hands had various latencies of the strongest "aha-response" peaks 
ranging from around 300—400 ms. We have presented also in the Figure[9]the results for a single subject in 
form of evoked response head topography and a single channel averaged SEP for targets and non-targets 
together with standard deviation error bars, which identified the statistically significant difference around 
400 — 500 ms for this particular subject. The signed statistical difference graph further confirmed the 
SEP separability in the above latency range. 

In Table[T]we also have presented the preliminary BCI experiment classification results with utilization 
of the PSOOCIassifier 7| package with ITR calculated in form of bit-per-minute-rate (BPMR) as proposed 
in [s]. The results for the three subjects are very promising taking into account a very conservative ISI 
of 600 ms which in our future planned experiments will be significantly shortened. 

As the final conclusion of the presented experiments we report on the very promising vibrotactilc 
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(haptic) BCI/BMI modality which is a step forward in creation of the more friendly paradigms. 
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Figure Legends 

Figure [l] Vibrotactile stimuli delivered to the left hand finger tips and the palm area using acoustic 
frequency tactile exciters. The right (dominant) hand is positioned on a response pad used in the 
psychophysical experiment. 

Figure [2] Psychophysical experiment results in form of response time delays to various vibrotactile stim- 
ulus frequencies for subject #1. The differences among stimulus frequencies are not significant in 
the tested frequency ranges. 

Figure [3] Psychophysical experiment results in form of response time delays to various vibrotactile stim- 
ulus frequencies for subject #2. The differences among stimulus frequencies are not significant in 
the tested frequency ranges. 

Figure [4] Psychophysical experiment results in form of response time delays to various vibrotactile stim- 
ulus frequencies for subject #3. The differences among stimulus frequencies are not significant in 
the tested frequency ranges. 

Figure [s] Grand mean average of the psychophysical response results for all subjects as from the exper- 
iments depicted in Figures [2]- 14] 

Figure [6] Averaged EEG ERP responses from the subject #1 for targets (the top panels), non-targets 
(the middle panels) and in form of correlation coefficients between the above conditions (the bottom 
panels). The X — axess represent time in milliseconds after the stimuli onset and the Y ~ axes 
EEG channels. The figure was created with PySGUI [9]. 

Figure [T] Averaged EEG ERP responses from the subject #2 for targets (the top panels), non-targets 
(the middle panels) and in form of correlation coefficients between the above conditions (the bottom 
panels). The X — axess represent time in milliseconds after the stimuli onset and the Y — axes 
EEG channels. The figure was created with PySGUI [9]. 

Figure [8] Averaged EEG ERP responses from the subject #3 for targets (the top panels), non-targets 
(the middle panels) and in form of correlation coefficients between the above conditions (the bottom 
panels). The X — axess represent time in milliseconds after the stimuli onset and the Y — axes 
EEG channels. The figure was created with PySGUI [9]. 
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Figure [o] The top panel presents a topographic plot of the single subject SEP response at 464.8438 ms 
where the largest difference between target and non-target ERP occurs, as presented in the middle 
panel together with stander deviation error-bars visualizing the statistical significance (around 
400 — 500 ms range). The bottom panel presents the signed statistical difference (i.e., signed r^) 
value which evaluates the discriminability between the two types of ERP. 



Tables 

Table 1. BCI EEG experiment classification accuracy and bit-per-minute-rate results. 



Subject 


Number of averages 


The best accuracy 


BPMR 


#1 


1 


75% 


19.81 bit/min 


#2 


2 


50% 


2.59 bit/min 


#3 


1 


75% 


19.81 bit/min 
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Figures 




Figure 1. Vibrotactile stimuli delivered to the left hand finger tips and the palm area using acoustic 
frequency tactile exciters. The right (dominant) hand is positioned on a response pad used in the 
psychophysical experiment. 



Psychophysical responses of subject #1 
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Figure 2. Psychophysical experiment results in form of response time delays to various vibrotactile 
stimulus frequencies for subject #1. The differences among stimulus frequencies are not significant in 
the tested frequency ranges. 
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Psychophysical responses of subject #2 
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Figure 3. Psychophysical experiment results in form of response time delays to various vibrotactile 
stimulus frequencies for subject #2. The differences among stimulus frequencies are not significant in 
the tested frequency ranges. 



Psychophysical responses of subject #3 
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Figure 4. Psychophysical experiment results in form of response time delays to various vibrotactile 
stimulus frequencies for subject #3. The differences among stimulus frequencies are not significant in 
the tested frequency ranges. 
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Grand mean of the psychophysical responses 
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Figure 5. Grand mean average of the psychophysical response resuhs for all subjects as from the 
experiments depicted in Figures [2]- 14| 
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Figure 6. Averaged EEG ERP responses from the subject #1 for targets (the top panels), non-targets 
(the middle panels) and in form of correlation coefficients between the above conditions (the bottom 
panels). The X — axess represent time in milliseconds after the stimuli onset and the Y — axes EEG 
channels. The figure was created with PySGUI |9j. 
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Target 




Figure 7. Averaged EEG ERP responses from the subject #2 for targets (the top panels), non-targets 
(the middle panels) and in form of correlation coefficients between the above conditions (the bottom 
panels). The X — axess represent time in milliseconds after the stimuli onset and the Y — axes EEG 
channels. The figure was created with PySGUI j9j. 



Target 




Figure 8. Averaged EEG ERP responses from the subject ^^3 for targets (the top panels), non-targets 
(the middle panels) and in form of correlation coefficients between the above conditions (the bottom 
panels). The X — axess represent time in milliseconds after the stimuli onset and the Y — axes EEG 
channels. The figure was created with PySGUI [ol. 
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464.8438 ms 





Figure 9. The top panel presents a topographic plot of the single subject SEP response at 464.8438 ms 
where the largest difference between target and non-target ERP occurs, as presented in the middle 
panel together with slander deviation error-bars visualizing the statistical significance (around 
400 — 500 ms range). The bottom panel presents the signed statistical difference (i.e., signed r^) value 
which evaluates the discriminability between the two types of ERP. 



